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Introduction. 

This paper is the next installment in a series 
(Sobieszezanski-Sobieski et al. 1998, Kincaid et 
al. 2000, 200 la, 1) and Plassman and Sobieszezanski- 
Sobieski 2000) that has introduced a variant of the 
Genetic Algorithm in which the reproduction mecha- 
nism was modified to base it on the Gaussian prol)- 
ability distribution, the bell curve. The bell-curve 
based (BCB) heuristic procedure, first presented in 
Sobieszezanski-Sobieski, Laba, and Kincaid (1998), 
is similar in spirit to Evolutionary Search strategies 
(ESs) and Evolutionary Programming methods (EPs) 
but has fewer parameters to adjust. In Sobieszezanski- 
Sobieski et al. (1998) B(’B was tested on a structural 
design optimization problem. 1 he quality of solutions 
generated were verified by comparing BCB solutions 
to ones generated by a standard nonlinear program- 
ming technique. No attempt was made to analyze the 
sensitivity of the BCB parameters. Kincaid, VVel)er 
and Sobieszezanski-Sobieski (2000) provide a prelim- 
inary investigation into BCB parameter selection as 
well as document improvements in the performance 
of B( 'B. ( •omputational results for continuous, dis- 
crete and mixed continuous and discrete design ojv 
timization problems with constraints is reported. Fur- 
ther experiments with B(>B for purely discrete op- 
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timization problems is provided in Kincaid, Weber 
and Sobieszezanski-Sobieski (2001a). Plassman and 
Sobieszezanski-Sobieski (2000) implement and test a 
parallel version of BCB for continuous optimization 
problems. 

rhe new contribution to be presented in this install- 
ment is an extension to applications that encompass 
a mix of continuous and quasi-discrete, as well as 
truly-discrete applications. The extension combines 
a definition of the distance between the parent designs 
in the space that comprises discrete and continuous 
variables with application to optimization of statically 
indeterminate structures in which the order of design 
variables, e.g. the type of the cross-section, is essen- 
tial. As expected, the algorithm that accommodates 
the order information produces better results. In addi- 
tion, we provide a comparison allowing sampling from 
the tails of a discrete normal distribution versus a stan- 
dard mutation scheme. Adding sampling from the tails 
brings the continuous and discrete versions of BCB 
into agreement. Moreover, given the same computing 
resources, we show that sampling from the tails of the 
discrete normal leads to higher quality solutions than 
the standard genetic algorithm mutation approach. 

2. Background Information. 

db illustrate the connection between BCdi, ESs and 
EFs we define our mutation, recombination, and se- 
lection mechanisms in ES and EP terms. A new gen- 
eration in our approach is selected exactly the same 
as a (// -f //)-ES. Idle recombination mechanism is 
similar to the extension of the intermediate recom- 
bination if the weights are recjuired to sum to unity. 
Consider the line through two n-dimensional parent 
vectors A and selected for mating as in Figure 
1, Figure 1 depicts a design space simplified to three 
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dimensions (three design variables). First, determine 
tlie weighted mean M of these two vectors where the 
weights are given by the fitness of each parent. Next, 
sample from a normal distribution N(0 ,ct 5^,,). The re- 
sulting point B = M — P]\* (0, fTm) is the child, 

prior to mutation. Note that in the extended version 
of the intermediate recombination method when the 
weights sum to one the unmutated child can lie any- 
where on the line segment between the two parents. In 
our approach, rather than picking weights arbitrarily, 
the selection is governed by a normal distribution and 
the fitness weighted average of the parents. Moreover, 
B is not restricted to lie on the line segment P\Pz’ 
Mutation ensues by first generating a radius r for an 
n — 1 dimensional hypersphere. The radius is a realiza- 
tion from a yV(0,<r^). Typically («t^ >> <Tm)’ Finally 
the mutated child C is selected by sampling uniformly 
on the surface of the n — 1 dimensional hypersphere. 
Since the child can lie anyw’here on the surface the ef- 
fect is similar to the rotated angle portion of an ES 
or EF (in n — 1 rather than n dimensions). However, 
we do not allow the hypersphere to be stretched (or 
shrunk) along any of its axes as is the case for an ES 
and El^ with non-identical rr,. VVe call our procedure a 
Bell- Curve Based evolutionary optimization algorithm 
(BCB). Figure 1 is a 3-dimensionaI view of BCB. 

In the case of constraints (or simple bounds) we 
make two adjustments to BCB, If the point B vio- 
lates a constraint then we select another candidate for 
B until we obtain a feasible one. That is, we sample 
from jV( 0, (Tm) until B ~ M \P -2 — Pi \ * jV(0,crrj,) is 
feasible. If the child C that is produced is infeasible, 
we translate the components of C to the closest con- 
straint, For example, if all variables are to lie w'ithin 
[1, 10] and if (7 == (0.8, 2.0, 11.9), the child would be- 
come (1.0, 2.0, 10.0). 

In addition to the general description of BCB above 
there are several specific details of note. Instead of 
a roulette wheel selection scheme for selecting parents 
we implement Baker's (1987) stochastic universal sam- 
pling. In doing so we eliminate the natural bias, noted 
by Baker (1987), in roulette wheel selection. Although 
BCB's performance may be improved if knowledge of 
the underlying feasible region’s topology is included in 
the selection of the initial population, here we gener- 
ate the initial population randomly (uniformly). There 
are four parameters that must be chosen to optimize 
a continuous unconstrained function: population size, 
number of generations, and Kincaid et al. 
(2001b) provide an investigation into B('B parameter 
selection. VVe make use of their observations in this 
manuscript. 

First, scaling with respect to the design variables is 
critical. BCB skew^s the search space towards design 
variables of small dimension during recombination. 
Hence, the search space should be scaled so that all 


design variables are of similar magnitude. Two normal 
distributions drive BCB — jV(0,o’„^) and .V(0,crr). As 
we seek to sample along the line through the two par- 
ents, Pi and P 2 , we form B = M-j-|^-Pi |*A' (0,rr„,). 
Computational experience in Kincaid et al. (20Ulb) 
showed that <7^ should have a value near 1.0. In- 
tuitively this makes sense since A (0,rr^) serves to 
inflate or deflate the value of the distance between the 
parents. Next, to mutate B we sample uniformly on 
the surface of an 7i — 1 dimensional hypersphere with 
radius sampled from our second normal distribution, 
A"(0, cr^). Here, the value of is expected to be larger 
than 1.0 to allow- for the possibility of hyperspheres of 
larger radii. Unfortunately there is no problem spe- 
cific data from which we can pick a baseline value for 
the radius of this hypersphere. A'(0 ,o-t.) must repre- 
sent both the unknown radius baseline as well as its 
normal deviation. As expected, Kincaid et al. (2001b) 
found that rr,. should be much larger than <r„,. Be- 
low^ is an outline of the B( -B procedure for continuous 
optimization problems. 



Fig. 1. BC!B Geometrical Construct in 3D Space 

Initialize BCB by choosing a population size, a max- 
imum number of generations, nurn^gens, and . 
Scale the search space so that all design variables are of 
similar magnitude. Randomly generate individuals. 

Repeat num.gtns times 
Repeat //. times 
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Select two parents, I\ and P 2 ^ from the 
current population using Baker’s stochastic 
universal sampling. 

Calculate M the fitness weighted mean 
of the parents. 

Generate B — M + \P -2 — P\ \ * ^ (^m.) > 

the child prior to mutation. 

(If B violates a constraint sample from 
A (0,rr„i) until a feasible B is found.) 

Generate C the mutated child. 

Sample from A (0,rr^) to determine r, the 
radius of a hypersphere centered at B. 

Sample uniformly on the surface of this 
hypershere. The resulting point is C. 

(UC is infeasible we translate the violated 
components of G to lie on the boundary 
of the violated constraint.) 

End Repeat 

Keep best of parents and children as parents 

of next generation 
End Repeat 

BCB was originally designed to find high quality so- 
lutions to continuous optimization problems. In order 
to solve mixed continuous and discrete variable opti- 
mization BCB must also be able to optimize purely 
discrete problems as well. Our first experiment in this 
regard was to simply round continuous BCB solutions 
to the nearest discrete value (see Kincaid et al. 2000) 
for a 2 -member hub design problem. This approach 
is known to work fairly well for quasi-discrete vari- 
ables, that is, the variables have a continuous physical 
interpretation but may be implemented only by choos- 
ing from a discrete set of options. 1 he thickness of 
commercially available sheet metal is an example. In 
contrast, the variables may be truly discrete. Choosing 
between propellers or jet engines in an aircraft design 
optimization problem is an example. The rounding 
approach is totally inapplicable for truly discrete vari- 
ables. C^onsequently, in the truly discrete setting there 
is no obvious analog to a line segment connecting par- 
ents. Defining an underlying geometry via a lattice 
is possible but our approach is to define an artificial 
neighborhood structure. 

The notion of a neighborhood we use rests on a def- 
inition of distance between objects in a finite set. This 
idea is not new. In particular, Kelly et al. (1994) use 
a similar measure in their diversification strategies in 
tabu search, lb the best of our knowledge there is 
no reference to this in the evolutionary strategy lit- 
erature. To be generic, consider an example of three 
objects, each possessing three attributes. Eigure 2b 
provides such an example in which the attributes are 


letters chosen from a list of six letters (Figure 2a). 
Initially we assume that the order of the attributes in 
the object does not matter. We will remove this as- 
sumption later. Now, consider object l) and ask the 
question: ‘ 4 iow many letters must be changed to make 
li identical to a?’*. By inspection, the answer is three. 
The answer to the same question for is two. Finally 
to change to d wo need change only one letter. Ob- 
viously, the above questions may be reversed without 
changing the answers. That is, the transformation of 
a to 7 also requires two letter changes. We now place 
a, and 7 on a numerical axis (Figure 2 c). Choosing 
a arbitrarily as a reference at 0 , then the locations of 
7 and /9 are 2 and ?> respectively. That is, each of these 
objects is placed at the number of attribute changes 
required to transform it to the reference object (o in 
this case). 


a) A B C D E F 

b) «= ABE^ B = [ DCF Y= [OVF ! 

c) a 7 P 


0 12 3 

Figure 2. Distance between members of a discrete set 

A definition of a distance between objects that are 
identified by attributes chosen from a finite set emerges 
from the example in Figure 2. 

• The distance between two objects characterized 
by discrete attributes drawn from the same set is 
equal to the number of attributes that must be 
changed in one object so that it is identical to the 
second object in terms of its attributes. 

The distance defined above might also be interpreted 
as the dissimilarity betwwn two objects. In this inter- 
pretation, the null distance corresponds to a complete 
similarity (identical attributes). The maximum dis- 
tance, the total number of attributes in the object 
(three in Figure 2), signifies a complete dissimilarity 
(no attributes in common). Note that the proper- 
ties of the similarity and dissimilarity are mutually 
complimentary their measures add to the number of 
attributes. 

NOw' consider the case w4ien the order of attributes 
in the object does matter. To illustrate the conse- 
quence, consider a transformation of 7 to a. In addi- 
tion to replacing the letters C and F with B and t 
respectively, one needs to change the position of A in 7 
from position 2 to position 1. Counting the two letter 
re]>lacements and the position exchange results in 7 to 
a distance of IE In addition to constructing the sin- 
gle transformations, such as 7 into o, we also want to 
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sample among all the objects at a prescribed distance 
( }>etween the two objects. Kincaid et ab (2000) ex- 
perimented with discrete problems in which the order 
of the attributes does NOT matter. In Section 4 we 
will provide computational experience for problems in 
which the attribute order does matter. 

The tacit assumption in the previous examples is 
that the number of attribute positions in each object 
are the same. Although this need not be the case in 
general, it will be true for the problems w'e study here. 
Given the aforementioned distance definition we can 
now formally describe a discrete version of BCB. \Vc 
describe the case when the positions of the attributes 
do matter since that is easier to explain. The symbols 
Pi, P 2 , and C (two parents and the resulting child) 
correspond to a, /T and 7 respectively in the previous 
discussion. Let k denote the number of attribute posi- 
tions in Pi and P2, let n denote the number of possible 
attribute values (n > k), and let r denote the number 
of attributes that are dissimilar between P] and P^. 

• Step 1 . Place P\ and P 2 on a numerical axis rang- 
ing from 0 to the number of dissimilar components 
between Pj and P2. Without loss of generality, let 
Pi serve as the reference point at 0 on this numer- 
ical axis. 

• Step 2. CTeate a truncated discrete normal dis- 
tribution on the axis described in step 1. The 
distribution is centered on a point M whose lo- 
cation may be at the midpoint between Pi and 
P2 or it may be shifted tow'ard the fittest parent. 
The distribution is truncated at Pi and P2. The 
parameter must be chosen by the user. 

• Step 3. Let t denote the sample value chosen from 
the distribution in .step 2. Place the child i? at a 
distance < from Pi on the numerical axis between 
Pi and P2. 

• Step 4. Reorder the attributes of P\ and P2 so 
that the k — r attributes in common appear in 
the last k — r attribute positions. Assign the re- 
maining r attributes of P] and P2 randomly to 
the first r attribute positions respectively within 
Pi and P2. Label these reordered parents P\ and 
P2- Construct a child B of P] and P2 as follows. 
First, set B — P2. Then re-assign the attributes 
contained in the first r — t positions of Pi to the 
first r — c attribute positions of P. 

• Step 5. Construct the final child C from B by 
randomly mutating P. That is, with a small prob- 
ability of occurrence, p, randomly (uniformly) re- 
place any attribute of P with any of the allowed 
attribute values. 

In addition to experiments in which the attribute 
order does matter we wdll also explore the utility of 


the truncated normal. In order to make the discrete 
version of BCB closer in spirit to the continuous one it 
w^ould be nice to replace Step 5 above with sampling 
in the tails of the discrete normal distribution. 

Lastly, we describe how these two algorithms in- 
teract when we solve mixed continuous and discrete 
optimization problems, we treat the discrete and con- 
tinuous variables as a single collection of decision vari- 
ables. Suppose that our design structure has b beams, 
and that there are t possible beam types. Further sup- 
pose that the cross-section of each beam type can be 
described by n continuous variables. Then our solu- 
tion is a vector r that is a concatenation of h vectors 
of the form 

(.r]i, . . 

with one such vector for each beam. Here, Xij repre- 
sents the jth cross-section decision variable of the ith 
beam type. Thus, a solution will describe not just b 
beams, but h*i beams. A second vector (4/i, jj 2 , , yh) 
indicates the chosen set of beam types, where yi is in 
the integral range of [l,t]. Hence, the value of iji in- 
dicates which beam type we have chosen for beam i. 
Given two parents of the form described above, con- 
tinuous BCB recombines the jps and discrete BCB 
recombines the tps. For further information on other 
possible ways to solve mixed continuous and discrete 
optimization problems the intere.sted reader is referred 
to Kincaid et al. (2001a). 

3. Refinements to Discrete BCB 

In this section we test certain features of discrete 
BCB. First we examine the two choices for M de- 
scribed in Step 2 of the algorithm. That is, should M 
be the the midpoint between Pi and P 2 or should it be 
shifted toward the fittest parent. Second, we compare 
the performance of discrete BCB as described above 
to a new version of discrete BCB in wdiich Step 5 is re- 
placed by allowing sampling to occur in the tails of the 
discrete normal distribution defined in Step 2. That 
is, the discrete normal distribution defined in Step 2 is 
no longer truncated. In addition we will limit our at- 
tention to problems in which the attribute order does 
NOT matter. 

The test cases for these experiments is a constrained 
mixed continuous and discrete w^eighted shape selec- 
tion optimization problem. We wish to select 5 shapes 
from a list of three (circle, triangle, and square) or 
more geometrical shapes. The five positions are num- 
bered in order 1 through 5. The goal is to choose 5 
shapes (possibly with repeats) and the dimensions of 
those five chosen shapes to minimize the total weighted 
sum of the perimeters. Each chosen shape’s perimeter 
is weighted by its position in the list: the first shape 
in the list is weighted by 5, the second by 4, the third 
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by 3, and so on. The continuous variable is the radius 
(r) for the circle, the length of a side (s) for the square 
and the length of the base (b) for a right isosceles tri- 
angle. The constraints are as follows. The total area 
must be greater than 100 units and each continuous 
varialde has a lower bound of 1 .0 and an upper bound 
of 10.0. The optimal set of shapes is 4 triangles and 1 
circle with an objective value of 82.9. Ihe circle has 
the smallest perimeter to area ratio (2/r) and is cho- 
sen for position 5 with r just large enough so that 100 
- (sum of the 1 triangles area) is satisfied. Small tri- 
angles are chosen for the remaining 4 shapes since its 
perimeter to area ratio is largest. In an attempt to un- 
derstand how^ BCB scales wdth respect to the numl>er 
of discrete variables we solve the position dependent 
shape prol)lem with the addition of regular polygons 
with 5, 0, 8, and 10 sides. 


Table 1. Using fitness: 15 reps, 20,000 solutions, 
0.04 mutation 


# 

Shapes 

Mean 
Best Ohj 

Mill 

Best Obj 

Max- 

Best Obj 

Freq Opt 
Shapes 

3 

85.9 

82.9 

89.1 1 

5/1 r, 

4 

87.4 

82.9 

94.3 

2/15 

5 

89.7 

85.3 

95. .3 

0/15 

6 

91.2 

85.1 

97.1 

0/15 

i 

91.0 

85.2 

97.6 

0/15 


Table 2. Using midpoint; 15 reps, 20,000 solutions, 
0.04 mutation 


# 

Shapes 

Mean 
Best Obj 

Min 

Best Obj 

Max 

Best Obj 

tVeq Opt 
Shapes 

.3 

85.7 

82.9 

89.4 

6/15 

4 

86.1 

82.9 

90.4 

5/15 

5 

89.1 

83.7 

93.2 

1/15 


93.0 

85.7 

98.1 

0/15 

i 

90.8 

83.9 

96.7 ^ 

0/15 


In the above experiment the fitness weighted mean 
in Step 2 of the algorithm does not perform quite as 
well as simply using the midpoint of P\ and p 2 - The 
midpoint approach has the min and mean best ob- 
jective values in 4 of the -5 cases and identifies more 
optimal shapes (12) than the fitness approach (7). 
Even so the appeal of making use of parent fitness has 
led us to continue with its use. One reason for doing 
so is to make the continuous and discrete implementa- 
tions of BCB as similar as possible. 

Ihe next set of experiments seeks to compare the 
truncated discrete normal with miitation versus a dis- 
crete normal distribution in Step 2 of the algorithm. 
The table below summarizes these experiments for the 
discrete normal distribution which can be compared 
against the results in Tables 1 and 2. Here we see that 
the use of tails for the discrete normal is beneficial. 26 
optimal shapes are found with the tails and only 12 
with the mutation approach. In addition, the mean 
best objective value for the tails approach wins in 4 of 


the 5 cases. 


Table 3. Discrete Normal with tails: 15 reps, 
20,000 solutions 


# 

Mean 

Min 

Max 

Freq Opt 

Shapes 

Best Obj 

Best Obj 

Best Obj 

Shapes 

3 

84.0 

82.9 

88.4 

13/15 

1 

85.6 

82.9 

90.(> 

7/15 

5 

89.0 

82.9 “1 

99.9 

5/15 

6 

91.3 

86.0 

99.9 

0/15 

i 

91.8 

82.9 

99.6 

1/15 


4. Hub Design Problem 

Our standard test problem in Sobieszczanski- 
Sobieski et al. (1998), Kincaid et al. (2000) and 
Kincaid (2001) has been a minimum weight (volume) 
design of a hub structure also found in Balling and 
Sobieszczanski-Sobieski (1994). Each member of the 
hub structure is an I-beam rigidly attached to the hub 
and to the wall, forming a tw*o-dimensional, w heel- 
wit h-spokes pattern whose tw'o-beam version is illus- 
trated in Figure 3. The structure load has three com- 
ponents, horizontal and vertical concentrated forces, 
and a concentrated moment, all acting on the hub 
in the plane of the structure. Various loading cases 
(h(Miceforth called '“loads'*) are formed from the above 
load components. Three loading cases are applied to 
a fj-beam structure, and tw^o loading case are used in 
case of a 20-beam structure to reduce the computing 
elapsed time. The beam cross-sectional dimensions are 
the design variables, and the constraint functions re- 
flect the material allowable stress as well as overall 
and local buckling. The top and bottom flanges of 
the I-beam are not necessarily of the same dimensions. 
Hence, the cross-section of each [-beam requires six 
design variables. Figure 3 illustrates a 2-member hub 
problem. Additional details may be found in Padula 
et al.(1996). The utility of the hub structure as a test 
case stems from its ability to be enlarged by adding 
as many members as desired without increasing the 
dimensionality of the load-deflection equations. These 
remain 3 by 3 ecpiations for a 2-dimensional hub struc- 
ture regardless of the number of members. While 
analytically simple, the hub structure design space is 
complex because the stress, displacement and buck- 
ling constraints are rich in nonlinearities and couplings 
among the design variables. Our goal is to extend this 
problem so that, in addition to choosing the dimen- 
sions of the beams so as to minimize the volume of the 
hub frame, we w’ould also select (among a finite list) 
the beam type. 

As a first step in this direction we consider 3 beam 
cross-section types -1, circular, and triangular. In all 
cases the overall length of the beam is held constant 
amongst the cross-section types. The I-beam has 6 
design variables; the circular beam has 2 design vari- 
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ables; and the triangular beam has 3 design variables. 
Our first experiment is with a (> beam 3 load hub de- 
sign problem. Each beam has the same nominal length 
of 120.0 and the following BCB parameters values: 



Figure 3, 2-member hub description 


population size : 20 

number of generations : 1250 

replications : 50 

PENALTY 1 : 2000.0 

PENALTY2 : 4000.0 


fitness-related meam for discrete 
normal number of swaps 

As a benchmark we force mixed BCB to choose all 
I-beams and obtain the following results: 



Order NOT 
Important 

Order 

Important 

min vol 

576.62 

554.51 

mean vol 

687.81 

681.02 

s.d. vol 

63.63 1 

126.33 


The case in which the order of matching elements in 
the parents matters leads to slightly better results. 
This trend has been borne out in all of computational 
experience although the order is important approach 
seems to require more generations to converge, VVe ex- 
pect this is due to the larger neighborhood of feasible 
solutions when order counts. 


With the penalties shown above, the maximum con- 
straint violations occurred as follows: 



Order NOT 
Important 

Order 

Important 

mean max. violation 

-0.00039 

-0.0085 

s.d. max. violation 

0.0027 

0.0596 


The following table lists the results when mixed BCB 
is allowed to choose one of three possible shapes (I- 
beam: 1 , circle:2, or triangle:3) for each of the six beams 
when the order does not matter in computing the dis- 
tance betw'een discrete components. 


Table 4: Frequencies of designs chosen 
(order does not matter) 


Design 

# 

Min 

Best Vol 

Mean 
Best Vol 

Std Dev 
Best Vol 

CbC2,2,2 

1 

456.90 

456.90 

- 

TUM,2,2 

1 

711.10 

711.10 

- 

1,^,1 , 0 ,...,^ 

1 

448.84 

448.83 

- 

1 1 

1 

404.51 

404,51 

- 

1 *> 

9 

383.29 

383.29 

0.001 


1 

429.78 

429.78 

- 

13b2,2,3,2 

1 

464.50 

464.50 

- 

2,1,1,222,2 

1 

416.85 

41 6.85 

- 

1 9 9 *> 

1 

462.20 

462.20 

- 

1 2 2 3 

1 

592.75 

592.75 

- 

9 1 9 3 9 

1 

447.83 

447.83 

- 

2,1,3,222,1 

1 

477.77 

477.77 

- 

9 9 9 1 9 9 

, I 

1 

417.72 

417.72 

- 

9 9 9 1 3 9 

1 

464.91 

464,91 

- 

9 9 9 9 1 1 

X, X 

1 

461.79 

461.79 

- 

9 9 9 9 1 9 

1 

383.20 

383.20 

- 

2,2,2,2,2,1 

1 

471.1 1 

471.11 

- 

2, 2, 2, 2, 2, 2 

8 

361.91 

365.98 

10,51 

222,2,2,2,3 

1 

426.61 

426.61 

- 

9 9 3 

9 

401.99 

422.61 

20.62 

9 9 9 3 9 1 

1 

533.66 

533.66 

- 

9 9 9 3 9 •> 

9 

416.74 

447.42 

30.68 

9 9 3 9 9 

9 

401.51 

401.51 

0.002 

9 3 9 9 9 9 

2 

424.75 

426.89 

2.14 

‘> 3 3 

1 

576.26 

576.26 

- 

2,3, 3, 2,2, 3 

1 

541.52 

541.52 

- 

2,3,3,3,2,2 

1 

502.52 

502.52 

- 

3,1,2,2,2,2 

1 

489.31 

489.31 

- 

3, 1,3, 3, 2,2 

1 

541.69 

541.69 

- 

3 9 9 9 1 9 

1 

429.18 

429.18 

- 

3 9 9 9 9 9 

7 

401.49 

401.49 

1.65 

3 3 9 9 9 9 

1 

527.12 

527.12 

- 


Best Designs: 

2. 2. 2. 2. 2. 2 with a minimum volume of 361.91 

3. 2. 2. 2. 2. 2 with a minimum volume of 401.49 
One of these two designs was selected 

30% of the time 

The following table lists the results when mixed BCB 
is allowed to choose one of three possible shapes (I- 
beam: 1 , circle:2, or triangle :3) for each of the six beams 
when the attribute order does matter in computing the 
distance between discrete components. 
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Table 5: Frequencies of designs chosen 
(order does matter) 


Design 

# 

Min 

Best Vol 

Mean 
Best Vol 

Std Dev 
Best Vol 


1 

421,07 

421.07 

- 

1 ') •; •> 

3 

383.19 

383.--M 

0.21 

2,2, 1,2, 1,2 

1 

404.90 

404.90 

- 

2,2,2,1,U 

1 

479.39 

479.39 

- 

2,2,2, 1,2,2 

3 

399.77 

477.93 

61.39 

1 •> 

2 

386.97 

436.16 

49.19 


2 

434.42 

488.10 

53.67 

•> ') *> ‘) '} 

22 

361.91 

362,00 


2,2,2,2,2,il 

1 

412.54 

412.54 

- 

•) •> [ 

1 

527.49 

527.49 

- 


3 

407.82 

427.82 

14.48 

2, 2, 2, 3,3,2 

1 

451.82 

451.82 

- 

i 

1 

441.57 

441.57 

- 

2, 2,3, 3,2,2 

1 

517,07 

517.07 

- 

2,3, 1,3,2, 2 

1 

538.54 

538.54 

- 

2,3,2, 1,2,2 

1 

485.36 

485,36 

- 

2, 3, 2, 2, 2, 2 

1 

410.65 

410.65 

- 

2,3, 2,2, 3,2 

1 

444.29 

444.29 

- 


1 

476.33 

476.33 

- 

*> •> •) ') '} 

1 

423.71 

423.71 

- 

:> .y .y .y O ,y 

1 

441.13 

441.13 

- 


following results are obtained \vhen mixed HCB is al- 
lowed only to choose I-beams: 



Order NOT 
Important 

Order 

Important 

min. vol. 

1 7089.629 

17112.098" 

mean vol. 

18984.661 

17869.609 

s.d. vol. 

20-6 1.77] 6 

128.5.047 


The use of the ‘‘order does matter' definition of dis- 
crete distance yields results that are only slightly bet- 
ter with respect to the mean but are significantly 
better with regard to the variance in the results. 

The following table lists the results when mixed BCB 
is allow'ed to choose one of three possible shapes (1- 
l>eam:l, circle:!^, or triangleril) for each of the six 
beams. 



Order NOT 
Important 

Order 

Important 

min. vol. 

12865.855 

13394.102 

shapes 

2, 2, 1,3, 2,2, 1,3, 2.2. 
2.3,2,1,1,2,2,2,2,1 

2, 2, 2, 2, 2, 2, 1,3, 2,1, 
2, 2, 2, 3, 3, 2, 2, 2, 2, 2 

mean vol. 

16140.339 

14278.798 

s.d. vol. 

1694.326 

1070.669 


Here we can see a significant improvement with the use 
of the ‘‘order does matter'* discrete distance definition. 


Best Designs: 

2. 2. 2. 2. 2. 2 with a minimum volume of 361.91 

1.2. 2. 2. 2. 2 with a minimum volume of 383.19 

2.2.2. 1.2.2 with a minimum volume of 386.97 

2,2,2, 1,2,2 with a minimum volume of 399.77 

One of these four designs was chosen 
607, of the time. 


With the same penalties as before, the maximum con- 
straint violations occurred as follow's: 



Order NOT 
Important 

Order 

Important 

mean max violation 

-0.076 

-0.0619 

s.d. max violation 

0.0849 

0.06 


The above tables indicate the trends we have seen in 
variety of problem instances. The “order does matter' 
approach residts in fewer, higher cpiality solutions and 
the distribution of final solutions is tighter (smaller 
variance) wuth a higher quality mean. 

Next, we consider a 20 beam 2 load hub design 
problem. Again all 20 beams are of the same nomi- 
nal length. The same UCll parameters were used as 
in the previous experiment except that Penalty 1 was 
increased to 10,000 and Penalty 2 was increased to 
20,000. With these penalties, the program had a con- 
dition added that the maximum constraint violation 
must be less than 0.02. Again, as a l)enchmark, the 


Next we increase the number of choices for the beam 
type (the only discrete variable) from 3 to 0. Ihe 
shape choices for each beam are 1:1, 2:circle, 3:triangle, 
‘hrectangle, 5:1’, or 6:C. This problem w*as run with 
all 0 beams having the same nominal length and the 
following BCB parameters: 


population size : 20 

number of generations : 1250 

replications : 50 

PENALTY 1 : 2000.0 

PENALTY2 : 4000 . 0 


f itness-related mean for discrete 
normal number of swaps 


The experiment was first run for the case w hen “order 
does NOT matter'* and, of the oU replications, only 
the following solutions w’ere repeated: 


Design 

# 

Min 

Best Vol 

Mean 
Best Vol 

Std Dev 
Best Vol 

1,2, 2, 2, 2,2 

2 

383.22 

383.34 

0.12 

— ,.w, 

2 

456.41 ' 

407..58 

1 1.17 


The range of values for all the solutions w^as 361.91 
(2. 2,2, 2, 2, 2) to 977.27 (5,6,4,5,2,1 ) with an average 
value of 533.11 and standard deviation of 1 19.91. 

The same experiment was repeated for the case when 
order does matter and, of the 50 replications, only the 
following solutions were repeated: 
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Design 

# 

Min 

Best Vol 

Mean 
[lest Vol 

Std Dev 
Best Vol 

0 1 •> •> *> 

9 

3S3.20 

383.32 

0.12 

'} 0 •> 
, 4 - 

6 

361.91 

376.94 

33.22 

•> 9 •> 5 

9 

395.20 

415.09 

19.89 

0 0 5 9 9 

2 

395.20 

449.81 

54.61 


The range of values for all the solutions was 3hl.91 
(2/2, 2/2, 2, 2) to 1322.02 (5, 2, 6, 2, 2, 2) with an average 
value of 520.35 and standard deviation of 148.02. If 
the single outlier value of 1322.02 is discarded, the 
maximum value is 701.03 (1/2, 2, 2, 3, 5) and the average 
value over the 50 replications is 507.85 with a standard 
deviation of 85.75. In this manner we have a tighter 
range of values then with the '"order does not mat ter'* 
definition of distance. 

Next we consider the 20 beam 2 load problem and 
use the same BCB parameters as in our previous 20 
beam 2 load case except that 6 shape choices (1:1, 
2;circle, 3:triangle, lirectangle, 5:1', or fi:C). are now 
available. This yielded the following results over 20 
replications: 



Order NOT 
Important 

Order 

Important 

min. vol. 

14949.145 

14359.097 

shapes 

2, 4, 4, 2, 2, 6, 1,2,2, 2, 
6,2,2,3,2,3,4,6,4,5 

4,2,4,5,1,1,4,2,2,4, 

2,3,3,2,5,4,3,2,2,6 

mean vol. 

16827.441 

15803.128 

max. vol. 

19001.340 

177.34.045 

shapes 

1,3, 4, 6, 4, 6,5, 6, 2, 6, 
5,2, 2, 5, 4, 4, 2,2, 1,1 

4, .5,4, 5,4, 1,2, 1,2,6, 
2,2,1,2,2, 1,5,2, 6,1 

s.d. vol. 

1233.146 

901.371 


The use of the "order does matter"* definition for dis- 
crete distance yields results that are both slightly 
better with respect to the mean and less spread out 
(smaller standard deviation) over the multiple runs. 

5. Concluding Remarks 

In this manuscript we have examined an extension 
of BCB that encompasses a mix of continuous and 
quasi-discrete, as well as truly-discrete applications. 
VVe began by testing two refinements to the discrete 
version of BCB. The testing of midpoint versus fitness 
(Tables 1 and 2) proved inconclusive. The testing of 
discrete normal tails versus standard mutation showed 
was conclusive and demonstrated that the discrete nor- 
mal tails are better. Next, we implemented these re- 
finements in a combined continuous and discrete BCB 
and compared the performance of two discrete distance 
on the hub problem. Here we found when "order does 
matter"’ it pays to take it into account. 

The computational experiments we have performed 
lead naturally to additional questions. Will the per- 
formance of mixed B( ‘B be improved if BCB is linked 


w ith pattern search? Pattern search is a derivative free 
local search procedure that has been showui to perform 
well on a variety of nonlinear optimization problems 
(see Lewis et al. 2000 for details). Previous work 
(Kincaid et al. 2001b) has shown that BCB coupled 
w'ith local search procedures wwks w'dl for the contin- 
uous version of BCB. The reasoning is that BCB does 
a good job of identifying valleys of interest but takes 
too long getting to the bottom. Will the same be true 
in the mixed continuous and discrete case? 

Our work here focused on a small scale structural op- 
timization problem for testing the performance of dis- 
crete BCB. It is natural to wonder if discrete BCB will 
stand up against other competitors-tabu search, sim- 
ulated annealing, and traditional genetic algorithms. 
A potential scalable problem venue to test this conjec- 
ture is the the NK-landscape model. The NK model 
is due to Kauffman (1989) and is a random energy 
model similar to a spin glass. It is designed to be tune- 
able, That is, as K increases the landscape becomes 
more rugged. When K = 0 a highly correlated land- 
scape wuth a single peak results. At the other extreme, 
when K = — 1 (where N is the number of decision 

variables) a completely uncorrelated landscape results 
with very many peaks. 
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